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Sir: 

Prior to initial examination on the merits, please amend the above- 
identified application as follows: 

IN THE CLAIMS : 

Claim 2, line 1, change "A" to —The—; 

Claim 3, line 1, change "A" to —The--; and delete "or claim 2"; 
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MICROSCOPY 

The present invention relates to telemicroscopy and 
microscopy training. 
5 Telemedicine, by which a range of data, such as x-rays 

or ECG traces, relating to a patient is transmitted from 
one location to another for diagnosis or a second opinion, 
is the focus of much attention because of its potential to 
improve the quality of healthcare while reducing costs. 

10 There have been many attempts at developing telemedical 
applications involving the use of microscopes, such as 
telepathology and telecytology . All involve the capture of 
digital or analogue images from a microscope and 
transmission of these images to a remote site for the 

15 purpose of a second opinion or remote diagnosis. However, 
as will be described, none of the existing systems has been 
entirely satisfactory. 

A fundamental problem in the field of telemicroscopy 
is that the field of view of the microscope is tiny in 

20 relation to the size of the specimen on the microscope 
slide. By way of example, a typical cytology 'smear 1 will 
occupy an area of at least 20mm by 50mm, that is 1000mm 2 . 
The field of view of a typical 20x magnification objective 
lens is only about 0.4mm by 0.4mm, or 0.16mm 2 . The entire 

25 image can therefore be considered to be formed by over 6000 
distinct fields. A remote consultant will not want to make 
a diagnosis on the basis of just a few images selected by 
another worker, he will want to have access to the whole of 
the slide and to be able to change or have changed the 

3 0 magnification as and where he wishes. 

The simplest solution to this problem is a procedure 
known as static tele-microscopy. In its very basic form, 
all that is required is a camera coupled to the microscope, 
some basic software, a network connection such as via the 

35 Internet to a remote display, and means for voice 
communication between the two locations. The microscope is 
operated by a local worker who will typically, based on 


their own knowledge, select an initial area for review by 
the remote consultant. An image of that area will be 
acquired and transmitted to the remote consultant's 
monitor. Based upon what he can see, he relays instructions 
5 over the telephone to the local worker - left, right, up, 
down, increase magnification, etc. Further images are 
acquired and relayed to the consultant until he is 
satisfied that he has sufficient information upon which to 
base his diagnosis. Such static telepathology systems have 
10 the virtue of simplicity and low cost. However, trials have 
repeatedly confirmed that it is unsatisfactory in practice 
to rely upon a few fixed images and few consultants will be 
prepared to offer an opinion or make a diagnosis on this 
basis . 

15 An improved system is known as dynamic telemicroscopy. 

Essentially, once the slide has been prepared locally, the 
microscope itself is operated remotely by the remote 
consultant. Examples are shown in US-A-5 216 59 6 and 
US-A-5 297 034. An example has also been placed on public 

2 0 access via the Internet by the Department of Pathology at 
the Charite Hospital in Berlin 

(http://amba.charite.de/telemic/index.html.) . However, 
such on-line systems are expensive both in terms of buying 
the equipment and in terms of the consultant's time. These 

2 5 systems also need high bandwidth telecommunications, 

typically at least 384 kbits/sec for even only moderately 
satisfactory use. Whilst the consultant has full control 
over the microscope, there are delays whilst instructions 
are relayed to the microscope, the microscope is adjusted 

3 0 in accordance with those instructions, and the new image is 

obtained and relayed to the consultant. Such systems cannot 
strictly be considered to operate in real-time. For a 
comparison, whilst a consultant operating a local 
microscope could perhaps examine a sample and provide a 
3 5 diagnosis in a straightforward case in around a minute or 
perhaps 3 or 4 minutes for a more involved diagnosis, 
whereas even with dynamic telemicroscopy and experienced 


operators each examination can take in the order of ten 
minutes or so. 

There is therefore a need for an improved method of 
telemicroscopy . 

The invention also relates to the area of microscopy 
training, and particularly to the area of teaching of 
diagnostic methods employing microscopy. 

At present training in diagnostic microscopy performed 
either by circulating prepared sections on glass slides 
formed by the circulation of electric microscopy images of 
a data storage medium such as CD ROM. The former of these 
two approaches is time consuming and inconvenient, 
particularly because samples get misplaced or damaged in 
transit. Both methods have the further disadvantage that 
there is both specific monitoring of whether or not a 
student performs a diagnosis simply by chance or by 
incorrect methods, meaning that both are limited teaching 
tools. 

In the context of telemicroscopy and indeed any form 
of microscopy where images are displayed on a monitor 
rather than viewed directly by the eye, it is perhaps 
misleading to talk in terms of magnification. If an image 
is obtained and displayed full screen on a 17 inch computer 
monitor, the magnification will be greater than if the same 
image is displayed full screen on a 15 inch monitor. The 
resolution will, however, be the same. Accordingly, the 
term resolution is a better descriptor of the amount of 
information given in a particular image and relates, in the 
context of a digital camera, to the number of pixels of the 
CCD device per unit area of field of view. 

According to the present invention, there is provided, 
in one aspect, a method of telemicroscopy comprising the 
steps of: preparing a specimen on a microscopy slide; 
placing the slide upon the stage of a microscope equipped 
with digital imaging apparatus and motorised stage; imaging 
the specimen to obtain a composite high resolution image of 
the whole specimen; digitally obtaining a relatively low 


resolution copy of that image; and storing the images in a 
datastore; wherein the method further comprises the steps 
of allowing access to the datastore from a terminal; 
transferring the low resolution image to the terminal and 
5 displaying the image upon a monitor; selecting by means of 
the remote terminal, as desired, an area of the low 
resolution image and transferring corresponding high 
resolution image data for that area from the datastore to 
the terminal. 

10 The terminal may be a remote terminal. 

The method may comprise the step of recording the 
areas of the low resolution image that are selected, for 
review of performance of a person performing the method. 

In a second aspect, the present invention provides a 

15 telemicroscopy apparatus comprising a microscope provided 
with a digital imaging apparatus and a motorised stage 
which can be controlled to obtain a digital image or 
plurality of such images, at a desired high resolution, of 
an entire specimen placed upon the stage; image processing 

20 means to obtain a low resolution copy of the image of the 
specimen; storage means to store the images obtained; and 
means for transferring, in use, image data to a terminal in 
response to requests therefrom. 

Preferably, the digital imaging apparatus is a digital 

25 camera, or else an analogue video camera provided with 
appropriate digit iser hardware. The apparatus may comprise 
means for moving the objective lens of the microscope in 
order to provide automatic focussing. 

In a preferred embodiment, a continuous sequence of 

3 0 successive images of the specimen is obtained by advancing 
the field of view of the objective lens of the microscope 
stepwise across the specimen and acquiring an image of each 
field of view. The objective lens is selected to ensure 
sufficient resolution in the images of the specimen and 

3 5 sufficient images are captured and stored to cover the 
whole area of the specimen on the microscope stage. 


The apparatus may comprises means for recording what 
image data is requested for review of the performance of a 
user. The recording means maybe a data storage disk, such 
as a floppy disk. 
5 With a knowledge of the pixel size and number in the 

imaging apparatus used and the calibrated magnification of 
the objective of the microscope, the computer moves the 
stage such that adjacent images are effectively continuous 
in the two dimensional specimen plane, and can be thought 
10 of as 'tiles' in a very large composite 'montage' virtual 
image . 

The above and other aspects of the present invention 
will now be described in further detail, by way of example 
only, with reference to the accompanying figures, in which: 

15 Figure 1 illustrates schematically an embodiment of 

the apparatus in accordance with the present invention; 

Figure 2 is complete navigational map of a sample on 
a microscope slide which has been imaged in accordance with 
an embodiment of the method of the present invention; and 

20 Figure 3 illustrates in further detail one aspect of 

the embodiment of Figure 1. 

Referring to the Figures, a biopsy sample for analysis 
is taken and mounted upon a microscope slide 10 in a 
conventional manner. The specimen slide 10 is placed upon 

25 a motor driven stage 11 of a microscope 12 fitted with a 
camera 13, typically a digital, high resolution CCD camera 
of diagnostic quality - at least 1024 x 1024 pixels, 24 bit 
colour. The stage is adjustable in three dimensions with 
respect to the focal axis of the objective. This is 

3 0 typically achieved with a computer 16 controlled motorised 
movable stage 11, but could equally well, if 
unconventionally, be achieved with a static stage and a 
movable objective. 

The objective lens 14 is selected according to the 

3 5 maximum desired resolution for the task in hand - typically 
10X, 2 OX or 4 OX. The complete specimen is imaged by 
capturing an image of a first field (or area of the 


specimen) 20, advancing the stage to an adjacent field 21, 
capturing an image of that field, indexing to the next 
field 22 and so on (referred to as scanning) . The 
individual field images 20, 21, 22 etc are stored on disk 
5 as part of a single large file or may be digitally 
compressed and stored electronically representing a high 
resolution virtual image of the original slide specimen. At 
the same time, a decimated copy of the very large image is 
created to represent a low resolution navigation map 30. 

10 Typically, the number of pixels in the low resolution map 
30 will be the same as that in each of the original images 
20, 21, for example 1024 x 1024. The total time for 
acquisition of the collection of high resolution images 
will typically be around 5-2 0 minutes, depending, of 

15 course, upon the specimen area to be scanned and the field 
of view of the objective lens. 

When scanning with the high power objective, a problem 
is often encountered in that it is difficult to drive the 
motorised stage, such that it is normal to the optical axis 

2 0 of the microscope. Indeed, microscope slides are not 

perfectly flat. Because of this, the need arises to 
refocus the microscope periodically when scanning a 
specimen. Refocussing adds significantly to overall scan 
time. This can be overcome with the present invention by 
25 means of a piezo-electric driver, or other objective lens 
moving device, rather than requiring the movement of the 
motorised stage relative to a fixed objective lens. 

This occurs before the consultant becomes involved and 
so maintains a high efficiency in terms of consultant time. 

3 0 In practice, based on a knowledge of the pixel size 

and number in the camera and the calibrated magnification 
of the objective of the microscope, the distance by which 
the stage must move between each image acquisition is 
calculated. The stage is moved to the co-ordinates of the 
35 selected starting point and the first image is acquired. 
The image is compressed and stored to disk and a 
low-resolution tile is made from that image. With a 


knowledge of where the tile image originated, the tile is 
"pasted" onto a navigation map matrix and stored. The stage 
is then advanced to the next co-ordinates and the next 
image is acquired. 
5 By making use of multi-thread software design, it is 

possible to optimise scan time by arranging for image 
compression and storage to run in parallel with stage 
movement and image acquisition. 

The microscope stage 11 and the CCD camera 13 are 

10 controlled by appropriate hardware and software of the 
server 15, in a generally conventional manner. 

As is evident from the image shown in Figure 2 , 
unevenness in specimen illumination may lead to a certain 
degree of shading around the periphery of each field image. 

15 If desired, the high resolution image can be digitally 
processed to remove this shading. However, it is envisaged 
that consultants will generally prefer to see a "raw" image 
for fear of the loss of important detail if the image is 
excessively post-processed. 

20 The navigation map 30 and collection of high 

resolution images are stored locally in computer memory in 
a computer or server 15. For a typical 20 x 50 mm specimen 
as described in the introduction, such a collection of high 
resolution images could be expected, with 50-100-fold 

25 digital compression, to occupy up to around 1Gb of memory. 
Typically, a compressed navigation map might be expected to 
occupy around 5 0Kb of memory. 

At this stage, access to the microscope is no longer 
required and it can be put to use on the next slide. 

3 0 Communication may now be made between the local server 15 
and the consultant at a remote computer 16, upon which is 
mounted the appropriate client software. Communication may 
be via a dedicated link, for example to a centralised 
expert diagnostic centre, or by any other suitable means, 

35 such as over the Internet even to a consultant's portable 
computer. The system is not limited to one: one connections. 


The server can be configured to support simultaneous access 
by multiple clients. 

At his client computer 16, the consultant receives the 
low resolution "navigation map' 3 0 of the entire specimen 
image from which he can access the high resolution images. 
As the compressed navigation map is comparatively small, 
there is only a minimal delay whilst the data is 
transferred. In its simplest form, an original high 
resolution image itself is retrieved simply by clicking or 
otherwise selecting the appropriate area in the navigation 
map 30. In another embodiment, the consultant is able to 
select any specific area of interest by "rubber banding" a 
rectangular region either on the client's navigation map 
display, or else on the currently displayed field of view. 
The server then extracts the appropriate high resolution 
image from a very large compressed file, then compresses 
this f ield-of-interest view and sends it to the client 
computer 16. 

Typically, the consultant will have two computer 
monitors, the first monitor 35 to continually display the 
navigation map 30 and the second monitor 36 to allow the 
consultant to display a high resolution image 40 of an area 
41 selected by the consultant by "rubberbanding" a desired 
area from the map 3 0 using, for example, a mouse connected 
to his terminal. The server 15 will immediately access the 
image store and construct a compressed image corresponding 
to the selected area for transmission to the client 
computer. In the limit of magnification, the enlarged image 
40 on the second monitor 3 6 will typically correspond to 
the magnification used in the scanning procedure, but it 
could typically be digitally enlarged up to around twice 
the scanned magnification without loss of apparent image 
quality. 

In a further preferred embodiment the remote 
consultant will be able to reconstruct the navigation map. 
If for example, it is clear at first sight that 50% of the 
navigation map 3 0 shows nothing at all or is not relevant 
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to the diagnosis, it may be distracting for the consultant 
to have it constantly displayed on the first screen 35. 
Accordingly, the consultant can 'rubberband' the desired 
area and the server will construct a new navigation map and 
5 transmit it to the client computer. Thus the new navigation 
map may be at the same resolution as the original map or at 
an increased resolution as desired. 

An advantage of the present system is that the complex 
and storage intensive data processing is carried out by the 

10 server 15 locally to the microscope, such that only that 
image data called upon by the consultant needs to be 
transmitted to the consultant's computer 16. That data is 
comparatively small and can thus be transmitted quickly. 
The client computer 16 is not required to carry out any 

15 complex data processing other than decompression and 
display of the images retrieved from the server. In 
addition, the server can be configured to allow multiple 
concurrent accessing of the data, for the purposes, for 
example, of multiple diagnosis or teaching. 

2 0 In the preferred embodiment illustrated, the second 

monitor 36 also displays small thumbnail images 45 of areas 
previously examined in detail as an enlarged image 41. 
These thumbnail images 45 are temporarily stored locally to 
facilitate rapid retrieval should the consultant so 

2 5 require. Ultimately, the original image data corresponding 
to the thumbnail images, and including the navigation map 
image 30, can be stored centrally constituting a part of 
the patient's medical records and also serving as an 
5 audit trail recording those areas of the slide which were 

30 actually examined by the consultant. The remaining high 
resolution images on the server can be discarded or backed 
up as desired. This illustrates a yet further advantage of 
the present invention. It is inherently well adapted for 
efficient data warehousing and provides a useful compromise 

35 between storing the whole data and storing no data. Neither 
of the existing dynamic or static telemicroscopy techniques 


can provide such a feature without considerable additional 
modification. 

Use of the present invention allows the remote 
consultant access to any area of the slide at will, and 
allows him to control magnification at will. In many 
applications, it is as fast as direct examination of the 
local slide. 

Having described the use of two screens, it will be 
immediately apparent that the same result can be achieved 
using separate virtual screens or windows within a GUI 
operating system upon the same monitor screen. 

The apparatus and method of the present invention are 
particularly well suited to the majority of occasions where 
an immediate diagnosis is not required and its primary 
advantage is in the speeding up of non-urgent cases. It 
avoids the need for microscope samples to be transferred 
between hospitals, being advantageous both in terms of 
reducing the delays due to samples being in transit and the 
risks associated with transferring possibly dangerous 
samples. However, the invention is also potentially 
suitable for those cases where an immediate diagnosis is 
required, for example when a frozen section sample has been 
taken from a patient during an exploratory operation. This 
feature will be particularly advantageous in highly 
specialised areas of medicine in which there may be only a 
few suitably experienced clinicians who may well be in 
other parts of the world when a diagnosis is required. 

In summary, the present invention overcomes the stated 
limitations of static telemicroscopy without the high cost 
entailed in dynamic telemicroscopy. Cost saving is 
primarily through reduction of consultant time. This is 
essential to realise the potential benefits to quality of 
diagnosis in routine telepathology etc. Furthermore, the 
scanning process can easily be adapted to unattended hatch 
processing, in which, not just one slide but a collection 
of slides is scanned sequentially. 
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The simplicity of providing multiple access to the 
server makes the invention ideal for teaching purposes , as 
well as for professional quality assurance assessment. 

The concepts described above can be applied as a 
5 teaching apparatus and for professional quality assurance 
by providing the apparatus with a return path in which the 
apparatus returns information about the fields of view 
selected by the operator. The apparatus may also provide 
means for enabling annotation to be inserted by a user to 

10 provide total feedback of the user's approach to a 
monitoring teacher. 

With such an arrangement it is not necessary to return 
actual images, but simply to return the bounds information 
on the boundaries of the field within the frame of 

15 reference of the large-scale virtual image. This is 
because the teacher has access to an exact copy and 
reconstruction can be performed at the teacher's server. 
In this way, an entire diagnostic session can be returned 
in a file which can be easily transmitted by E-mail or on 

20 a floppy disk, for example. 

Whilst, as with the above example, the image provider 
(teacher) and the image reviewer (the student) can be at 
either end of a local area network or other 
telecommunications, other possibilities are available. For 

25 example an appropriate data storage device, such as a CD- 
ROM could incorporate all of the image data and when loaded 
into an appropriately configured PC can emulate a remotely 
accessed system. 
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CLAIMS 


1. A method of telemicroscopy comprising the steps of: 
preparing a specimen on a microscopy slide; placing the 
slide upon the stage of a microscope equipped with digital 
imaging apparatus and motor ised stage; imaging the specimen 
to obtain a composite high resolution image of the whole 
specimen; digitally obtaining a relatively low resolution 
copy of that image; and storing the images in a datastore; 
wherein the method further comprises the steps of allowing 
access to the datastore from a terminal; transferring the 
low resolution image to the terminal and displaying the 
image upon a monitor; selecting by means of the remote 
terminal, as desired, an area of the low resolution image 
and transferring corresponding high resolution image data 
for that area from the datastore to the terminal. 

2. A method according to claim 1, wherein the terminal is 
a remote terminal. 

3. A method according to claim 1 or claim 2, further 
comprising the step of recording the areas of the low 
resolution image that are selected, for review of 
performance of a person performing the method. 

4. A method according to claim 1, 2 or 3, wherein a 
continuous sequence of successive images of the specimen is 
obtained by advancing the field of view of the objective 
lens of the microscope stepwise across the specimen and 
acquiring an image of each field of view. 

5. A telemicroscopy apparatus comprising a microscope 
provided with a digital imaging apparatus and a motorised 
stage which can be controlled to obtain a digital image or 
plurality of such images, at a desired high resolution, of 
an entire specimen placed upon the stage; image processing 
means to obtain a low resolution copy of the image of the 
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specimen; storage means to store the images obtained; and 
means for transferring, in use, image data to a terminal in 
response to requests therefrom. 

5 6. An apparatus according to claim 5, wherein the digital 
imaging apparatus is a digital camera. 

7. An apparatus according to claim 5 or claim 6, 
comprising means for moving the objective lens of the 

10 microscope in order to provide automatic focussing. 

8. An apparatus according to claim 5, 6 or 7 comprising 
means for recording what image data is requested for review 
of the performance of a user. 

15 

9 . An apparatus according to claim 8 , wherein the 
recording means is a data storage disk, such as a floppy 
disk. 
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ABSTRACT 

A method of telefluoroscopy comprises the step of 
preparing a specimen on a microscopy slide. The slide is 
5 placed upon the stage of a microscope equipped with digital 
imaging apparatus and motorised stage and the specimen 
imaged to obtain a composite high resolution image of the 
whole specimen. A relatively low resolution copy of that 
image is obtained and stored in a datastore. The method 

10 further comprises the steps of allowing access to the 
datastore from a terminal transferring the low resolution 
image to the terminal and displaying the image upon a 
monitor selecting by means of the remote terminal, as 
desired, an area of the low resolution image and 

15 transferring corresponding high resolution image data for 
that area from the datastore to the terminal. 
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Figure 2 



